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I. lOTBODUCTION 



GENERAL STATEMENT ABOUT THE NATIONAL APTITUDE SURVEY 

The purpose of this battery of tests, entitled the National Aptitude Survey , 
is to identify future automotive repairmen. It provides the basis for a pre- 
diction as to how likely it is that a male student in the ninth or tenth grade 
of a public high school, who has attained a particular score, will enter the 
field of automotive repairmen within three years after graduation. Those stu- 
dents identified as being the likeliest future automotive repairmen, conse- 
q.uently, could benefit the most from school courses oriented to such a career. 

A boy’s chances of being an automotive repairman is determined by comparison 
of his obtained score for the appropriate tests with a normative distribution 
of scores obtained from -nearly all the participants in the study. The pre- 
diction of a boy’s chances takes the form of a likelihood estimate which indi- 
cates the increase in accuracy to be gained from knowing a test score in con- 
trast to not knowing it. 

The National Aptitude Survey incorporates three important aims: specificity 
in its orientation to a particular field; representativeness in its normative 
group; and longitude in its predictions. It is specific in that it is intended 
to predict entrance and success in the occupation of automotive repairman; 
representative in that its normative population of ninth-grade males represents 
the general ninth grade students for whom the Survey is designed; and longi- 
tudinal in that test performance at the ninth and tenth grade levels serves to 
predict for each student the probabilities of successful performance as a me- 
chanic several years after testing. These features should make this instrument 
especially useful to guidance counselors in their counseling of students at 
these same levels of schooling. 



THE NEED FOR THE NATIONAL APTITUDE SURVEY 

As the products of a technological society increase in number and attrac- 
tiveness, concurrently there develops a need for a group of individuals skill- 
ful enough to service them. One ever-present danger has been a widening dis- 
crepancy between dispersion of a product and its maintenance. Consumer satis- 
faction with a purchase influences his attitudes toward newer developments in 
the same product. 

In the automotive field, as in other areas, the quality and number of 
individuals who become automotive repairmen exert a strong influence on the 
customer’s attitudes toward performance of the product. For some time, the 
percentage of qualified individuals entering the trade o? repairman has not been 
sufficient to satisfy the demand. Changes in occupation, subsequent to their 
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employment, have further intensified the need. Yet, large numbers of un- 
skilled youth are entering the available work force. That there exists a need 
for skillful automotive repairmen may be largely unknown or uninteresting to 
them at this stage of their career. 

After high school, the range of occupational opportunities does permit a 
short period of trial-and-error choices, but at the expense of possible income 
and available time. Testing and counseling at this time under the direction 
of agencies within society may alleviate the situation somewhat by restricting 
the range of suitable and possible alternatives. Nevertheless, one could argue 
that counselors in high school could have guided those youth who showed an apti- 
tude for automotive repair into courses which would have provided training 
prior to entry into the trade. 

The University of Michigan was approached by Andrew Althouse, a represen- 
tative of the AI-VE Conference (Automotive Industry-Vocational Education Con- 
ference) to consider the possibility of conducting research in the selection of 
auto mechanics. A proposal was prepared and submitted to the Service Manager's 
Committee of the Automobile Jfenufacturers ’ Association, and in September 1957 
a grant of $l40,000 was made by that association to The University. 

At the time of the conceptualization of the National Aptitude Survey , 
there was no known instrument in existence designed specifically to predict 
success in the trade of automotive repairman which did not possess intrinsic 
limitations. A survey of the available instruments revealed features in their 
validation which militated against their use. Indications of low utility to 
the study were such features as lack of independent cross-validation, validation 
based upon individuals already employed, the limited size of the validational 
samples, limitations of the population to workers in a single plant or company, 
inflated correlation coefficients, and lack of published literature that eval- 
uated the tests adequately. The National Aptitude Survey incorporated into its 
design features intended to circumvent the difficulties that plague other tests. 
These included: 

a. validation based on a sample of participants who became automotive 
repairmen several years after the testing; 

b. utilization of validational devices that would minimize error; 

c. cross-validation upon a random subsample of the test participants. 

The psychological assumption that underlies the National Aptitude Survey 
is that it is possible to specify some predictors of success in the career 
field of automotive repairmen. The identification of possible factors which 
could contribute to an aptitude in this career field was the focus of the ini- 
tial efforts in developing the test battery. The subsequent pilot investigation 
encompassed a survey of related research and the compilation of detailed job 
analyses. " 
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An analysis* of the records made available by the Connecticut vocational 
schools provided information about the predictive power of some of the factors 
considered relevent. Knowledge of the Abstract Reasoning scores obtained through 
administration of the Differential Aptitude Tests improved prediction of both 
Auto Theory grade and overall grades in technical training by 29^ and 25^ re- 
spectively (N = 22) over no such knowledge at all. This same set of scores, 
however, was not predictive of occupation after graduation (N = l8). Number 
of children in the family proved useful in predicting entrance into the field 
f automotive mechanics, an improvement of over ignorance of such infor- 
^tion. 

A more direct source of information was an intensive series of job analy- 
ses by the first of the co-authors ( 65 ). These analyses, combined with a thor- 
ough review of the literature, provided a list oi factors of abilities (such as 
intelligence, space perception, and reasoning), factors of past learning (pre- 
vious job experience and type and length of training) , personality factors 
(temperament, emotional stability, rigidity, and patience), as well as factors 
of interest (hobbies, values, and goals) and of a biographical nature (resi- 
dence, number of children in the family, occupation of parents), all of which 
are related to entrance and success in the automotive field. 

Perceptive individuals have long recognized the need for specific aptitude 
tests in place of, or as a supplement to, tests of general mental ability. In 
the last three decades, a number of such tests have appeared, and the National 
Aptitude Survey represents a contribution to this trend. 

The definition of aptitude utilized by the Differential Aptitude Tests 
(9, p,2) reflects accurately the thinking which guided construction of the pres- 
ent battery: 

Aptitude; A condition or set of characteristics regarded as 
symptomatic of an individual's ability to accoutre with train- 
ing (usually specified) some knowledge, skill, or set of re- 
sponses, such as the ability to speak a language, to produce 
music . . 0 



The National Aptitude Survey avoids the assumption that the special apti- 
tude sought is an innate characteristic of the individual acc^uired through 
heredity. Inheritance may limit the potentialities of the individual, but 
within limitations a wide variety of learnings is possible. The Survey dem- 
onstrates that the individual performs in a certain way which is related to 
the behavior of automotive repairmen in a work situation. The demonstration 
of this relationship involves a comparison between the behavior shown by this 

*"Analysis of Existing School Records from Vocational Schools, University 

of Mchigan — Automobile I’feinufacturers Association Research Project , I960 
(unpublished study). 
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same individual who has become a repairman, and the behaviors he displayed in 
the test situation several years earlier. The term, ’’behavior," in this con- 
text represents an interaction of his heredity and environment, the result 
not only of his potential, but also of his learning. His intelligence, achieve- 
ment, personality interests, and skills, as well as the nature and quality of 
the opportunities inherent in his environment, all contribute to the measured 
behavior. The expectancy of success, derived from valid predictors, obviates 
the need to specify as either innate or acquired the origin of any character- 
istic. 



THE ADVANTAGES OF THE NATIONAL APTITUDE SURVEY 

The possibility that more tlan one factor of ability contributed to success 
as an automotive repairman suggested that a combination of certain tests would 
be the best predictor. Each test would have to make its unique contribution, 
and failure to do so would result in its elimination. 

Whenever there has existed a need for a combination of tests to measure 
an aptitude, one practice has been to assemble several worthwhile, but unique, 
tests to measure it. The very urgency of the need frequently has led to tolera- 
tion of what is basically a questionable practice. Each such test presumably 
underwent its own independent development and the subsequent linkage of dis- 
parate tests has usually left unanswered the question as to the nature of the 
new relationships between them. A gratuitous assumption of equivalence of ^ 
population and purposes should not be considered merely incidental to the in- 
terpretation of results. The development of the National Aptitude Survey ^ 
proceeded with one population and purpose in mind, at almost the same period 
of time; the interpretation of the relationships between its tests requires 
no assumption of equivalence for the following reasons: 

a. The fact that all subtests were standardized at the ninth- and tenth- 
grade levels, the levels at which it is to be used, should eliminate 
the difficulties that arise from using a combination of tests stan- 
dardized on population other than the desired one; 

b, Whereas a use other than the intended one may result in differences 
in matters such as format, administrative procedures, the use of 
answer sheets, and time limits other than those originally specified, 
the National Aptitude Survey tests avoid these liabilities due to the 
care and industry that in each instance attended their experimental 
determination on a specified population. 



THE DEVELOPMENT OF THE NATIONAL APTITUDE SURVEY 

The final form of the battery is the result of an effort to subject each 
item to pretesting, statistical analysis and revision. The testing occurred 
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in "bhrs© phss6si pre'tes'bing (nin'th”gr£ici6 siudsnis in "ths Ann Arbor Schools)^ 
local testing (schools in the vicinity of Ann Arbor) j and area testing (schools 
in southeastern Michigan and a northern section of Ohio). By the termination 
of this segment of the development phase the research team had eliminated several 
tests for reasons such as lack of reliability and/or lack of unique measurement, 
and had revised the length of others. 

Two criteria guided the decisions to include an item in a particular test; 

a. There had to be a high biserial correlation coefficient between an 
item’s score and the total score on the test. The biserial correla- 
tion coefficients served as a measure of the internal consistency 
of the test. 

b. Each item had to have a difficulty index which ranged from .15 to 
085. A value on this index referred to the percentage of individuals 
that passed the item out of all who attempted it. The items in each 
test were representative of the entire span of allowable difficulties. 



THE SAMPLE 

Organization Of The Sample 

The drawing of the sample followed the two requirements of a normative 
sample: it was large and representative. The sample size sought was 10,000, 

or one out of every 150 male students estimated from official publications to 
have been enrolled in ninth grades nationally, at the time prior to the national 
testing. The sample design specified a stratified, multi-stage cluster sample 
with probability proport. ional to size. 

One feature of the sampling procedure was the use of a "measure of size." 
The design required that every pertinent school in the population of eligible 
schools located throughout the continental United States had a chance of being 
represented. There were 15^^ schools in the 66 sampling Strata, denoted by 
the 66 Primary Sampling Units (PSU). The unit for the "measure of size" was 
25. Schools with a 25±12 ninth-grade students received a "measure of size" 1; 
those with 50 ± 12, a size of 2; those with 75 - 12, a size of until all 
the schools had some numerical equivalent of size. 



Another feature was a recombination, for administrative reasons, of all 
sampling units into clusters of fifty students. Schools with the "measure of 
size" 1 were combined with other similar schools to form a school of size 2, 
if selected, all the ninth-grade boys in these schools would take the tests. 
For schools with a "measure of size" greater than 2, a "systematic" subselec- 
tion was obtained. The formula for this procedure was 2 /s±; in which Si e- 
qualled the measure of the size of the ^th school. Thus in a school of size 
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12 f (N of ninth graders = 300 i 12) the subselection ratio was 2/l2 = l/6— or 
one out of every six boys. By means of alphabetical lists of all ninth grade 
boys in the school it was possible to select those to oe tested. Within the 
first six names at the top of the list the research staff selected a starting 
number at random^ then by means of a constant interval of six chose the re- 
maining names. A school of size 12 would yield a group of approximately 50 
pupils for testing (l/6 of 500 ± 12 boys). The actual size of the group, 
however, depended on the accuracy of the estimate of the school, and on the 
proximity of the actual ninth-grade male enrollment to tiie midpoint of the 
class interval of "measure of size." Of two schools with the same "measure 
of size," e.g. , 12, one could have yielded kS boys (N=288), the other 52 (N=312). 



Selection Of The Sample 

The actual selection of the desired sample occurred during the summer of 
i960. The resulting sample contained 256 schools out of a possible 15^ > with 
189 clusters of fifty boys out of a possible 4012 in the 66 P. S.U, Eighty- four 
of the 256 schools originally had a "measure of size" of less than 2; the re- 
mainder ranged from 2 to 52, with a median at 5« 



Results Of The Selection And Subseq.uent Testing 

Testing in the schools began in the Spring of 196 1 and ended in the Fall 
of the same year. Out of 256 schools selected, 1?^ (7^^) participated in the 
testing; the remainder did not find it convenient to take part in the program. 

The tested sample corresponds very closely to the one selected in terms of 
the "measure of size" of the schools. There are no over-representations of cer- 
tain size of schools or under -representations of others; the median represen- 
tation of each level is 75^ — that is, on the average about 75^ of each size 
of a selected school is represented in the tested sample. 



The Entire Sample And The Validation Sample 

For the general male population, the rate of entry into the trade of auto- 
motive repairman is estimated to be about 2^ yearly. It would req.uire the 
s0]_0Q'bion of a sample size of nearly 10,000 to obtain a validational group of 
200 cases. The establishment and determination of norms, regression eq.uations, 
and expectancy tables made such a sample size imperative. The deficiency in 
numbers, which resulted from the less than total participation, obligated the 
research staff to augment the number of students tested, if an adequate sample 
of automotive repairmen was to be obtained, A second sample of 8o4 tenth 
grade boys in 12 Michigan and 9 Connecticut trade schools also took the tests. 
The percentage of students from such schools who enter the trade of automotive 
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repairman is considered to be higher than the from the general population. 
This group is known as the Non -Probability Sample of Tenth-Grade Boys. 



Longitudinal Aspects Of The Sample 

During the year that followed each administration of the test battery, the 
Project staff began a procedure designed to maintain contact with every indivi- 
dual who had participated. Every year, at intervals of approximately fourteen 
months, each tested student, now known as a participant , received a questionnaire 
designed to elicit information about his school. He usually gave his present 
status, and any changes of address. After graduation, another questionnaire 
requested his work history. Those who became automotive repairmen became the 
validation sample. Information about the validation sample appears in the 
validation section( Section Vl) . There were three follow-up questionnaires in 
all. 



By January, 1967, more than three years after the end of the First Follow- 
up, the rate of failure to maintain contact had increased (Table l). The divi- 
sion of the table according to kind of sample obscures the fact that the time 
of the contacts was different. Each follow-up usually lasted more than four- 
teen months; the SuiTey staff would first attempt to contact the non-proba- 
bility and a greater part of the probability sample. Mailings to the re- 
mainder of the probability sample followed seven to eight months later.* Yet 
the percentages of returns or nonreturns for either sample are similar. 



*This procedure reflects the order of testing. One hundred seven schools, 
including the majority of those in the probability sample and the entire non- 
probability sample administered the tests in Spring 1961. The remaining 
schools in the probabiljty sample held testing sessions in Fall, 196 I. The 
earlier schools would have graduated their students in Spring, 1964, three 
years after the test; the later group would have been graduated in Spring, 1965* 
At the time of the validational study each participant could have had at 
least two, and possibly three, years of experience as a mechanic after 
graduation. 
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ERIC 



A. Jan. 1, 1964 23 2.9 

Non-response 1967 112 l4.1 



